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Abstract 

This paper examines the role of elaborations in learning a procedural skill (viz. using 
a personal computer) from an instructional text. Experiment 1 compared two sources of 
elaborations: those provided by the author and those generated by learners while 
reading. In the latter condition, subjects were given advance information about the tasks 
they were to perform so that they would generate more specific, task-related elaborations 
while reading. Each source of elaborations facilitated skill performance. This result 
contrasts with past experiments testing declarative knowledge in which author-provided 
elaborations were found to hurt performance. !n Experiment 2, the author-provided 
elaborations were classified into those illustrating the syntax of the operating system 
commands and those explaining basic concepts and their applicability. Syntax 
elaborations proouced significant facilitation for experienced and novice computer users. 
Concept elaborations produced no reliable improvement. 
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An important question to both memory theorists and pedagogists is what variables will 
improve the learning and retention of written information. One such variable that has 
been the topic of considerable speculation and research is the effect of elaborations 
(Anderson & Reder 1979; Reder 1976: Reder 1979: Weinstein, 1978: Mandl & 
Batlstaedt, 1981; Mandl. Schnotz & Tergan, 1984: Bransford, 1979: Chiesi, Spillch & 
Voss. 1979; Craik & Tutving. 1975; Reder. in press). In the view of most researchers, 
there are several reasons why elaborations should help subjects learn and remember the 
main ideas of a text. Elaborations provide multiple retrieval routes to the essential 
information by creating more connections to the learner's prior knowledge. If one set of 
connections is forgotten, it may be possible to retrieve the desired Information another 
way. Furth^^r if the learner forgets an important point, it may be possible to reconstruct 
it from the information that is still available. 

Elaborations can arise from two distinct sources: first, the text itself can contain 
elaborations of the main ideas and second, the reader can generate them independently 
while reading. We use the same term for both types because we define elaborations as 
any informd' on that supports, clarifies, or further specifies the main points of a text. 
Elaborations can take .nany forms including examples, details, analogies, restatements or 
deductions. There are merits and drawbacks to both the elaborations generated by the 
reader and to those provided by the author Elaborations provided by the author of the 
text may be more '^curate than those the reader can come up with, since the author is 
presumably more knowledgeable about the topic. On the other hand, the reader's own 
elaborations are likely to be more relevant to his or her immediate purpose for reading. 

There has been ample research supporting the idea that reader-generated 
elaborations facilitate retention. This suppoii comes from experiments where subjects 
have additional knowledge that allows them to generate more elaborations than other 
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subjects. Some experiments contrast subjects with a lot of domain-relevant knowledge 
(for example, about baseball), to those with little relevant knowledge (e.g., Chiesi, Spilich 
& Voss, 1979; Afkes & Freedman. 1984). Other experiments provide some of the 
subjects with additional information that is relevant to a passage to be read (e.g.. 
Bower, Black & Turner, 1979; Sulin & Dooling, 1974; Brown. Smiley, Day & Townsend, 
1977). In all cases, subjects who were able to bring to bear more relevant knowledge 
were more likely to intrude not-presented but relevant information and were also more 
!ikely to false-alarm tp plausible inferences based on this additional information. 
Therefore, it is reasonable to conclude that these subjects are in fact elaborating on the 
presented material with their relevant prior knowledge.^ More important from our 
perspective, these subjects also show significantly better retention of the gist of the 
material and better understanding of it (Anderson & Pichert, 1977; Arkes & Freedman, 
1984; Bartlett, 1932: Bower, 1976, Brown et a, 1977; Dooling & Cristiaansen, 1977; 
Owens & Bower. 1977; Schallert, 1976; Weinstein, 1978). 

Although reader-generated elaborations have been found to facilitate retention, the 
evidence concerning author-provided elaborations indicates that they do not provide 
similar benefits. Author-provided elaborations may in fact impair retention of the central 
ideas, as compared to studying these ideas in isolation. In ten separate studies. Reder 
and Anderson (1982. 1980) found that students who read fully elaborated chapters taken 
verbatim from standard college textbooks consistently performed worse than students who 
read chapter summaries that were one-fifth as long. The advantage for the summaries 
(which appeared in both reaction time and percentage correct measures), held up at a 
variety of retention intervals (ranging from 20 minutes up to one year), and it held for 
various tests of declara^'ve memory, including forced-choice verification, short answer, and 
free recall (Allwood. Wikstrom & Reder. 1982). Performance was better even on new 
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material when previous. reLted material had been studied in summary form. The 
advantage for summaries was also found under a varety of study conditions. In the 
inital experiments, a fixed study time was imposed on subjects in both text conditions. 
However, Reder (1982) also found an advantage for summaries in a non-laboratory 
setting in which subjects studied the materials at home at their own pace. Furthermore. 
Reder and Anderson (1982) equated reading time for each presented sentence in both 
conditions. That is. the main points were presented for equal amounts of time in 
isolation on a computer screen, with subjects in the elaborated condition taking 
additional time to study elaborations after each main idea. Performance in the summary 
condition was again superior.^ 



Not all research on author-provided elaborations has found that elaborations impair 
learning. However, the conditions under which such elaborations benefit the learner tend 
to be rather specialized. 

• Stein and Bransford (1979) studied subjects' recall of an adjective cued by 
the sentence frame within which it had been studied. The elaborations in 
these cases were additional phrases or clauses that increases the importance 
of the adjective to the plausibility of the sentence. 

• Mandl. Schnotz and Tergan (1984) found that elaborated texts facilitated 
recall and comprehension, but only when the reader was very knowledgeable 
in the toDic area; otherwise elaborated texts produced worse performance 
than unelaborated ones. 

• Rothkopf and Billington (1983) found that elaborated passages were 
sometimes superior to unelaborated passages, but only when they were mixed 
into the same texts; when one text was uniformly elaborated and another was 
summarized, the summarized version produced better retention of the central 
points. 

• Bradshaw and Anderson (1982) attempted to devise especially related 
elaborations that would facilitate recall of an entire sentence (cued by the 
sentence subject). For a fixed amount of study time, the best they could do 
was to get equivalent learning performance in tne elaborated condition and in 
the isolated (urslaborated) condition. 



Overall, the pervasive finding seems to be that, especially with a fixed study time. 
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people learn facts best when they study those facts y^ithout reading elaborations. Yet, 
the finding that author-provided elaborations are often ineffectual and sometinfies even 
detrimental to learning is a serious and curious charge. The implications for textbook 
production would be grave if one actually believed the result. One factor that we 
behove is crucial to the effectiveness of the elaborations found in instructional texts is 
the kind of learning that is expected to ^ake place. Indeed, educators and laymen alike 
will often assert that it is much less important to know a set of facts than to know how 
to use these facts. A similar distinction between fact learning and skill learning has 
received considerable attention in recent years in the cognitive science literature under 
the iabel of declarative versus procedural learning (e.g., Anderson, 1980; Posner, 1973; 
Shiffrin & Schneider, 1977). Below, we briefly contrast the nature of each kind of 
learning and explain why we expect author-provided elaborations to play a different role 
in each. 

Why do author-provided elaborations impede fact learning? 

There are several characteristics of tests of factual knowledge that may lead a 
person to perform better after studying a summary than a full, elaborated text. First, 
tests which ask subjects to recall or recognize studied statements require retrieval of 
specific facts leamed at a particular time. The stronger the trace the more likely that it 
will be retrieved at test. A proposition or fact is strengthened in memory to the extent 
that the subject devotes inore attention to it. Studying summaries facilitates performance 
on tests of iactual knowledge, because it allows the reader to devote full attention to 
the essential facts, exactly those that must be retrieved at test. In other words, 
studying elaborated texts impedes learning the main points of the text because reading 
the elaborations reduces the amount of time subjects can devote to the main points. 
This Total Time Law is a well established verbal learning phenomenon (e.g., Bugelski. 
1962: Cooper S Pantle. 1967). 
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The Total Time Law cannot completely explain the advantage ot the unelaborated 
versions, however When study tinr.e was equated for main points but one condition also 
gave additional time to study related facts after each main idea, performance was still 
Significantly worse with the additional facts (Reder & Anderson, 1982). An obvious 
explanation for the result is that elaborations can also interfere. Interference differs from 
the Total Time explanation in that it affects retrieval rather than encoding. There is 
ample evidence for the existence of retrieval interference on both recall (e.g., Postman. 
1971; Postman & Stark. 1969) and on response times to verification (e.g., Anderson, 
1974; Reder & Anderson. 1980). 

Another reason that elaborations do not help performance in factual tests is that 
there is little uncertainty in the testing situation about how to apply the knowledge. In a 
recognition or a recall test, it is usually clear what information is needed, when or why 
to retrieve it and what to do with it once it is retrieved. The information found in an 
elaboration is seldom called on in such tests and therefore only distracts the reader, 
when his or her time would be better spent studying the targeted facts themselves.^ 

Why might author-provided elaborations facilitate skill teaming? 

Our conjecture is that tests of fact learning place specific demands on the retrieval 
processes and that studying summaries focusses subjects attention in just the right 
places to produce the best performance. This analysis suggests that author-provided 
elaborations can facilitate performance if the tests no longer place such a high premium 
on retrieving just the main points. When subjects must "use" the information in the 
sense of determining appropriate contexts and methods of application, then we expect 
the benefit of the additional information for performing the tasks to outweigh the liability 
of having less study time for the main points and additional retrieval competition. 
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Our s^'Jdies deal with a task that involves the acquisition of a cognitive skill (namely, 
learning to manipulate files and directories on a personal computer), in which a small 
set of basic procedures can be applied to a variety of novel situations. Good skill 
performance on a novel task requires three things: (1) Appreciating the meaning of 
concepts novel to the new skill domain. For example, in learning to use an IBM 
Personal Computer, one might be introduced for the first time to function keys that allow 
the user to re-execute a command that was already issued, without retyping it. (2) 
Remembering and comparing procedures to select the most appropriate one for tne 
situation at hand. "Knowing" at some level that such a function key exists does not 
mean that the user will remember to use the function key rather than retyping the 
command. (3) Remembering the exact syntactic form for the procedure and how to apply 
it in a specific situation. A user might remember that the typing step could be saved 
by using the special key but be uncertain as to which of the ten function keys performs 
that function and exactly how to apply it, e.g., must a carriage return be issued 
afterwards, or an escape key'' 

Elaborations in the text may touch on any of these topics: the basic concepts, when 
they are relevant and how one applies them. For example, when the goal of a task 
does not exactly match the function of any known procedure, a subject with deeper 
understanding of the function of each individual procedure may more easily construct an 
effective combination. Elaborations about what conditions affect the usefulness of a 
procedure can help subjects plan out mo^e efficient sequences of actions. Finally, 
supplementing a general syntactic rule for a computer command with specific examples 
can help subjects set more specific standards for what their own commands must look 
like. 

Elaborations seem most important for learning to select and execute procedures 
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correctly There is some experimental evidence that examples facilitate the selection and 
execution of procedures in other skill learning situations. Ross (1984) found that subjects 
choose between equivalent computer text-editing procedures on the basis of the 
superficial similarity between the nomine' situation at tes: and the situation evoked in 
instructional examples. Pepper (1981) too found that students attend closely to 
examples. Those who read a carefully written computer procramming chapter that 
included numerous examples not only rated it more highly than comparable chapters 
without examples, but also answered more programming problems correctly than students 
who read the other chapters. 

In Experiment 1. we cross the availability of two sources of elaboration on skill 
performance: whether or not elaborations are present in the instructional manual and 
whether or not readers receive information about the tasks before they read the manual 
Providing prior knowledge of the test material has been explored extensively in tests of 
declarative memory. (See R.C. Anderson & Biddle. 1975; Reder. 1982. in press; and 
Rickards, 1979. for reviews.) Readers perform better on tests of factual knowledge when 
they are given the questions prior to studying the material: however, if they are given 
prior knowledge of only some of the questions, they perform poorly on the unexpected 
test questions. In a skill learning domain such as this, we expect prior knowledge of 
the task again to facilitate performance by focussing the reader's attention and 
stimulating the generation of task specific elaborations. 

In the fact learning literature, there is evidence that a subject's own elaborations are 
better retained than those provided by the experimenter (e.g., Bobrow & Bower. 1969; 
Rohwer & Ammon. 1971; Rohwer. Lynch. Levin & Suzuki. 1967, Rohwer. Lynch. Suzuki & 
Levin, 1967). Nonetheless, we suspect that in a skilMearning domain, reader*generated 
elaborations will be less reliable than those the author can provide. Thus, while we 
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expect reader-renerated elaborations to improve subjects* performance relative to having 
no source of elaborations available at all. it is unclear how they will ccmi^are to author- 
provided elaborations and how they will interact. 

Experiment 1 

In this experiment, subjects were asked to read one of two versions of a user's 
manual for the IBM Personal Computer (IBM-PC). We then measured their facility at 
using the computer without the manual, to perform a specific set of tasks. 

Method 

Design 

The experiment used a 2x2 between-subjects factorial design, where the first variable 
manipulated whether the document contained elaborations or not, and the second varied 
whether subjects read the task instructions prior to studying the document or not. 
Subjects were randomly assigned to conditions, with the constraint thai they be evenly 
divided among the four conditions. Although we noted how much previous computer 
expeJence our subjects had. we did not control for this variable in assignment to 
conditions, except for ensuring that no subject had ever worked on a microcomputer. 
Rather, we used prior experience as a covariate in our data analyses. 

This experiment actually contains two experiments, the second a virtual replication of 
the first. Any differences in materials or procedures will be noted, as will the rationale 
for any modifications in the replication. 

Matehals 

Two versions of a user's manual were developed for teaching novices to use the 
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Disk Operating System (DOS) on an IBM-PC. Both versions were constructeo by 
modifying portions of the Official IBM (1983) documentation. The same basic information 
was presented in both versions: they differed only In the degree of elaboration of 
concepts and procedures for using the described commands. The manuals were divided 
into two sections. The first section discussed concepts underlying the IBM-PC and its 
operating system such as disk drives, directories and subdirectories, and the use of 
wildcard characters. This section laid the groundwork for the specific commands 
discussed in the second section, since the command syntax requires the "location'' of 
an object (such as a file or a directory) to be specified in terms of a disk drive and a 
pat', through a hierarchy of directories and subdirectories. The second section of the 
documentation introduced eleven DOS commands (a complete list is provided in Appendix 
1). Tha manual described what each command does, what parameters must be 
specified when it is issued, anv optional parameters, and any other speciai Information, 
such ab how the computer interprets wildcards in the context of that command. 

The unelaborated version of the document was constructed by deleting portions of 
the elaborated manuai. such as examples, analogies, metastatoments. and definitions. 
Appendix 2 sho>'vs corresponding sampie*^ -if the elaborated and unelaborated manuals 
for each of these types of elabor^' » ^ .ie of the elaborations contained any new 
information necessary to completing the criterio:i tasks. The elaborated version contained 
more than twice v) many words .is the unelaborated version. (In the first run of the 
experiment, the elaborated version contained 11.216 words and the unelaborated 5.011: 
in the replication experinent, the manuals were trimmed to 10.605 and 3.542 words, 
respectively.) 
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Two IBM Personal Computers, each with two disk drives, were connected by a cable 
between their serial ports. Software was developed to record the subject's interactions 
with the computer. While the subject issued commands at one IBM-PC. the commands 
and the computer's responses were echoed across the cable and recorded (with a 
timestamp) in a file on the second IBM-PC, which was screened from the subject's view 
by a room-divider. 

Sufjjects 

Eighty*eight members of the Carnegie-Mellon University community (students, faculty, 
and staff members) participated in the experiment, 45 in the first replication, and 43 in 
the second. All subjects were occasional-to-frequent users of C-MU's DEC-20 computer 
system, running the TOPS operating system (a system which does not support 
subdirectories). No subject had previously worked on a micro-computer. Three subjects 
were non-native speakers of English, but fluent enough to completely understand the 
documentation. Subjects received either money or class participation credit or a 
combination of the two. (In the replication, only subjects who had taken no more than 
one computer programming course were allowed to participate. Initially we paid 
$4.00/hour for participation but lowered our rate to $3.00/hour for the replication.) 

Procedure 

Experio'ental sessions consisted of a reading period followed by a task performance 
period. At the outset of the reading period, half the subjects (the ''Before'' group) were 
given printed instrjctions describing the criterion tasks, which they read before reading a 
version of the manual. The other subjects (the ''After" group) did not see these 
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instructions until just before they performed the tasks. Within the Before and After 
groups, half the subjects read the elaborated manual and naif the unelaborated version. 
All subjects were told to review the important points as often as time permitted, since 
the manual would not be available while they performed the tasks. Subjects studied the 
manual while seated in front of the IBM-PC. They were told to examine the keys 
refer'^ed to in the documentation, but not to issue any commands, touch the machine or 
take notes. When the reading period was over, the experimenter returned to remove the 
manual and begin the task performance phase. 



Below are the task instructions used in the replication. 

These tasks will allow you to practice using the concepts you learned from 
the manual. You may work on these tasks in any order. Continue working 
until you are satisfied that you have completed the tasks to the best of your 
abilities. We want you. however, to work as efficiently as possible. 

Task 1. Before you, in drive A, is a diskette containing a number of files. 
Some of these files have the word "PART* in their names, such as file 
"PART.l." We want you to chenge the names of these files. Tne new name 
that you should give each file appears as the first line of that file. So, inspect 
the contents of each file that now has "PART* in its name and give the file 
the name that you find on the first line of the file. * 

Task 2. Four of the files on the diskette have the word *OATA'' in their 
nameSt and the abbreviation of a month in their extension, such as DATA. MAR. 
We want you to create a fifth data file named ALLOATA.83 that contains the 
contents of the other four data files appended together. Within ALLOATA.83. 
the files should appear in chronological* order: that is. the contents of 
DATA. MAR should precede the contents of OATA.JUN because tJ(a\ch is earlier 
in the year than June. 

Task 3. Next, you should create two subdirectories, on the diskette in drive 
B. One subdirectory is to be named PROGRAMS and the other named DATA. 
Move all the files that have the word * Program* in their names from drive A 
into the PROGRAMS directory on drive B. And, similarly, move the *Oata* files 
(including ALLOATA.83 from Task 2. if you have already created it), into the 
DATA directory. You do not want any Program or Data files to remain on the 
diskette in drive A. 

Task 4 Finally, you should eliminate the SOURCE directory and everything it 
contains from the root directory of the diskette in drive A. The root directory on 
drive A should now contain only a list of files. 
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Your task is complete! 



Even though the computer recorded all interactions with the subject, the experimenter 
was present to determine if the subject had arrived at an impasse, i.e., could not 
complete part or all of the current task. Either the subject gave up or was stopped 
after approximately 10 minutes of fruitless effort. At this point, the experimenter replaced 
the diskette the subject was working on with a prepared diskette on which th^ 
procedures for that part of the task had already been completed. In this way, the 
subject could proceed to the next part of the task as if he or she had actually 
completed the problematic part. Subjects were not allowed to ask questions* unless the 
question was of a superficial nature, e.g.. which key was the carriage return (this was 
not immediately obvious on the IBM-PC keyboard). The entire experiment took 
approximately 1.5 hours. 



A few differences in procedure between the two replications are worth noting: 

• The first 40 subjects were given a fixed 45 minutes to study the manual; the 
second group of subjects were given up to 60 minutes, but were permitted 
to stop sooner if they wanted to (study times were collected). In both cases, 
subjects were tcid when half the (maximum) study time had elapsed. We 
gave a variable reading time in the replication because we felt that subjects 
in some conditions did not have enough time to study the manual when 
given only 45 minutes. 

• In the replication, subjects in the Before group were allowed to keep the 
task instructions while reading the manual. Initially, the Before group gave 
back the instructions after reading them once, and saw them for the second 
time when the task performance phase started (i.e., when subjects in the 
After group first received them). Allowing the subjects to keep the 
instructions was intended to eliminate the additional memory load of the t^sk 
instructions while the subjects read the manual and to minimize the possibility 
of mis-remembering the tasks while studying the manual. 

• The task requirements in the replication differed from those used for the first 
version of the experiment in three ways. First. Task 2 was added in the 
replication to provide broader coverage of the commands in the manual. 
Second, Tasks 1 and 3 were made less repetitive (e.g., subjects renamed 6 
files in the replication as opposed to 15 files). Finally. Task 4 was modified 
to force subject*^ to draw more on what they learned about subdirectories. 
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Subjects were now forced to specify paths to deeply embedded subdirectories 
in their commands or change the default directory in order to successfully 
complete the task. 

Results 

The data of eight subjects were discarded (leaving exactly 40 per replication), five 
due to computer failure^ two because they were so inexperienced with computers that 
they refused to continue the experiment shortly after beginning the criterion task, anb 
one because his prjtocol revealed that he had worked on the tasks for several minutes 
during the study period. 

In the replication, subjects were allowed to study the manual for up to one hour 
(rather than a fixed 45 minutes). The mean reading time was 49 minutes for the 
Eiaborated-Before condition, 48 minutes for Elaborated-After. 45 minutes for Unelaborated- 
Before and 40 minutes for the Unelaborated-After condition. The differences in reading 
time as a function of condition were not significant: however. 60% of the subjects in the 
Elaborated-Before condition studied the manual for over 50 minutes while only 10% in 
the Unelaborated-After condition did so. 

In the analyses reported below, we always included the factor of "replication.* There 
were no significant efiects due to replication for any of the dependent measures, nor 
any significant interactions of replication with any of the factors. Therefore in our 
discussion of the results we will ignore the replication factor. 

Scoring. The protocol of a subject's interactions with the computer were stored in a 
file which was subsequently analyzed by means of a computer program. The program 
allowed the experimenter to partition the protocols accordirtg to which task the subject 
was working on. The program counted commands and calculated time intervals, both 
Within and across task "partitions.'' e.g.. how often a subject issued the "TYPE* 
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command while working on Task 1. The partitioning of the prrtocols was carried out 
independently by two judges for a random subset or the data. The agreement between 
the judges was quite high (r«.98); any disagreements were resolved to mutual 
satisfaction. 

There are many conceivable measures of performance. Rather than attempting to 
report them all (consult Heder, Charney & Morgan 1964 for a more thorough summary), 
we have selected a few representative measures: percentage of tasks completed, time 
spent on task, number of commands issued to perform the tasks, and performance 
""efficiency' for completed tasks only. Efficiency was defined as performance relative to 
the minimum number of commands required. These measures are presented in Table 1 
as a function cf whether each source of elaborations was available. 



INSERT TABLE 1 ABOUT HERE 



A consistent pattern emerges with all measures of performance, although some more 
strongly than others. Performance is better if subjects have an elaborated representation 
of the material; however* one source of elaboration is sufficient and it does not matter 
whether it is author-provided or subject-generated. Another way to put this is that the 
unelaborated manual in the situation where subjects did not have prior knowledge of the 
task produced the worst performance by all measures. 

The performance measure producing the smallest effect was the proportion of tasks 
completed correctly, displayed in the top row of Table 1. Each task was scored 
individually for a subject, with partial credit awarded for getting any part of a task 
correct. These data represent the mean scores over all tasks attempted. There are no 



19 



Reder 16 
significant effects of either experimental variable on the ability to finish the assigned 
tasks, although the condition with no source of elaborations appears to be slightly worse. 
(In the first run of the experiment, performance ranged from 75% to 93%. The 
Elaborated manual in the After instructions condition produced significantly better 
performance than the other three conditions; however, when study time was allowed to 
Deviate up or down from the enforced 45 minutes, all conditions had performance of 
about 80%.) We take this relatively high level of performance as evidence that even our 
minimar (unelaborated) manual adequately explained the concepts and procedufes so 
that all subjects could perform the tasks competently, at least when no time restrictions 
were imposed on task completion. 

There were significant effects of elaborations on the quality of the perfc.mance by 
such measures as the time taken on the tasks and the number of commands issued. 
The second and third rows of Table 1 present these data. Subjects were significantly 
faster to perform the tasks if they had read the elaborated manual (31 Tiinutes versus 
38 minutes). /={1.72)«5.6. MS^«161. p<.01. Subjects in the Elaborated-After condition 
issued Significantly fewer commands than subjects in the other three conditions. 
/(72)«3.5, S^.5.9. p<.Ol. 

The time and steps measures just reported include data from tasks which subjects 
failed to successfully complete (i.e., they received nc credit or partial credit for their 
work on the task). The scores for the incomplete tasks might skew these measures; the 
scores could be artificially high if subjects persist in working on a task without success, 
or artificially low if they give up immediately when they don't think they can do it. 
Therefore, the number of commands a given subject issued for a completed task was 
compared with the minimum number required for that task. The ratio of actual steps to 
minimum required are given in row 4 of Table 1. We call this measure efficiency. 
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There was a significant interaction of the extent of elaboration with whether subjects 
had prior knowledge of the task on efficiency, /={1,72)»6.82, MS^« 1.6. p<.05. 
Performance in the Elaborated-After condition was superior to the other three conditions. 
(((72)>2.2. S^>.24, p<.Q5). The unelaborated manual produced somewhat better 
performance than the elaborated manual when subjects had prior knowledge of the 
required tasks (the Before conditions); however, the interaction is due primarily to the 
worst condition (Unelaborated-After). where subjects read the unelaborated manual without 
prior knowledge of the tasks. No contr; involving the Elaborated-Before condi;ion by 
itself was significant. 

Discussion 

In the introduction we noted that both *he Total Time Law and the phenomenon of 
retrieval interference would predict that author-provided elaborations should hurt the 
acquisition and retrieval of central ideas from a text. Since the findings that such 
elaborations hurt performance were based exclusively on declarative knowledge tests 
(recall or recognition), we hypothesized that in a skill learning domain, studying 
elaborations would help a learner decide which procedure to apply to solve a given 
problem and how to apply general rules in specific situations. 

It would be useful at this point to summarize our findings: All conditions managed 
to complete roughly the same proportion of the tasks; however, subjects who studied the 
elaborated manual worked more efficiently tha^ subjects who studied the unelaborated 
manual in terms of both the time they spent on task and the number of commands they 
issued. Subjects consistently performed poorly in the Unelaborated*After condition, whore 
no extra source of elaborations was available This result is in sharp contrast to the 
results of, for example. Reder and Anderson ( 1 980: 1 982) where subjects always 
performed at least as well with the unelaborated version of a text. So there is support 
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for the hypothesis that, unii e in the domain of declarative fact learning, studying 
elaborations in a text does help people perform a skill. 



One area of past research reviewed earlier did find that elaborations improve memory 
for main points: recall is better when people can use prior knowledge about a topic to 
generate their own elaborations while they read. H^'^a, too, we found some evidence 
that having a specific task or problem in mind while reading a manual helps people 
apply what they are reading to those tasks. However, our results suggest that when 
people already know what tasks they must perform, they benefit very little from seeing 
examples and other elaborations in the text. The reader can process the manual 
selectively and generate his or her own lask-specific elaborations. The elaborations in 
the manual are less relevant (to the specific tasks) and appear to distract the reader 
from this critical process. WhiL :^ubjects who did not have the tasks in mind is they 
read were much better off with the elaborated version of the manual, subjects who knew 
about the tasks in advance performed just as well with the shorter, unelaborated version 
of the manual. This suggests that one source of elaborations is sufficient, i.e., 
perforrnance is not better with multiple sources of elaborations. 

It is interesting to speculate about why performance in the Elaborated-After condition 
was often significanth' better than the other three conditions. In particular, why didn't 
having both sources of elaborations available in the Elaborated-Before condition boost 
performance above that of either source alone? We suspect that, in part, it is 
unnecessary to have two sources of elaborations and in part, having both sources 
available makes it more difficult to exploit either one. It was too demanding in the 
Elaborated-Before condition to process the author-provided elaborations, keep in mind the 
task requirements and generate task specific elaborations. The reading time data in the 
replication provides some evidence for this interpretation: 60% of t'le subjects in the 
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Elaborated-Before condition studied the manual for over SO minutes, while only 30% of 
those in the Elaborated-After condition did so. However, having more time to study the 
manual in the replication did not improve the relative performance of this condition. 

How does performance in the Elaborated-Afte.^ condition compare to that in the 
Unelaborated-Before condition? Although the cell means for the Elaborated-After 
condition are better on all measures, the differences in most cases are not very large 
and do not differ reliably from the Unelaborated-Before measures. (Typically, the 
Elaborated-After condition was significantly better than the other three conditions 
combined,) To the extent that the Elaborated-After condition can be singled out as 
superior to the other conditions that provided some source of elaboration, we would Wke 
to conclude that author-provided elaborat^cis are superior to the ones that the reader 
can generate independently. We believe, however, that such a conclusion would be 
premature. 

We hypothesized at the outset that author-provided elaborations would help in a skill- 
learning situation because, unlilce simple declarative learning situations, good performance 
requires judging the appropriateness of the stored information to the task context and 
generalizing contexts of application (for a rule) to novel situations.^ Given that we have 
found that author-provided elaborations do help in a sicilt-learning situation, it becomes 
interesting to determine whether the advantage of elaborations is related! to identifying 
contexts of application, as hypothesized, or due to some other aspect of a slcill learning 
situation that is not shared by the standard declarative tests. 

We have implied that the sicill-learning tests tap "understanding" in a way that the 
declarative tests of prior research do not. On the other hand, the difference between 
the two learning situations is not simply that one requires a deeper understanding or 
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greater ability to recognize contexts of application. For example, acquiring the skill of 
using a computer requires that subjects learn the exacf syntax of commands that will be 
needed to perform a task. Many other skills, too. involve abstract rules for manipulating 
symbols, e.g., mathematics and writing. Learners must not only remember an abstract 
rule, but also produce a specific instantiation of the rule that is appropriate for the task 
at hand.^ 

« 

Given that subjects who did not have advance knowledge of the tasks performed so 
much more efficiently after reading author-provided elaborations, we wondered whether 
the benefit of the elaborations was for choosing the most efficient applications of 
commands or for learning to implement the command syntax. For example, a number 
of elaborations in the manual gave advice about when to use short-cuts (such as 
wildcard characters) in commands. If these elaborations helped subjects remember to 
use the shortcuts at appropriate times, then these subjects should have been able to 
complete the tasks with fewer cjmmands. On the other hand, the manu?' also 
contained many examples of syntactically correct, commands and detailed explanations of 
what the riotation meant. If these elaborations helped subjects frrmulate correct 
commands, then the greater overall efficiency would be due not to the efficiency of the 
solution, but rather the subjects' ability to carry it out. 

One source of information on this question is the on-line record of the subjects' 
interactions with the computer. We analyzed twenty on-line protocols from the 
Elaborated-After and Unelaborated-After conditions. 10 for each version of the manual. 
The commands that the subjects issued were categorized into five types: ^ 

• Productive moves: syntactically correct commands that carry out a "target 
action" or that enable one. 

• Verification moves: commands that check whether a previous command had 
the desired effect. 
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• Execution errors: commands that contain one or more syntactic errors. 

• Goal specification errors: wrong command issued or failure to perform a 
prerequisite action. (Subject may have some misconception about current 
state of the computer or the capabilities of a command.) 

• Recovery moves: commands to gain information after an e''ror or to undo its 
effects. 

Table 2 displays the distribution of commands that fall into each ot these five 
categories for each subject as a function of type of manual studied. If the elaborations 
had helped subjects generate more efficient solution strategies, then we would have 
expected subjects in the Elaborated group to need fewer productive moves. However, 
while the Elaborated group did issue slightly fewer productive moves, the differences foi 
both the Productive moves and the Verification moves are negligible. On the other 
hand, subjects who read elaborated manuals issued less than half as many commands 
that were syntactically incorrect, and this difference was significant, 1(1 8) » 2.6, MS^ >4.1, 
p<.05. Further they made half as many goal specification errors and took only half as 
many moves to recover from an error. The latter contrast was also reliable. 1(18) « 2 3. 
MS^«4.1. p<.OS. So subjects who studied the elaborated manual not only got the 
syntax correct more often, they were also better at knowing what commands to generate 
and at fixing commands that were wrong. 



INSERT TABLE 2 ABOUT HERE 



The results of the protocol analysis suggest that the ber /its of elaborations may be 
due to the syntactic elaborations, i.e.» that specify how to perform a procedure. The 
next experiment separated the syntactic elaborations from the general conceptual 
elaborations, varying the presence of the two types orthogonally. Conceptual elaborations 
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should be important in a skill task if the facilitating effect of elaborations for skill 
acquisition results from a need to determine the appropriateness of the stored 
information to the task constraints. On the other hand, if elaborations help in a skill 
situation because of the difficulty in learning how to generate syntactically correct 
commands, then only the syntactic elaborations or examples will facilitate performance. 

EXPERIMENT 2 

Experiment 1 used manuals that either elaborated both concepts and syntax or 
elaborated neither. For this experiment* we created two additional versions of the 
manuals so that we could orthogonally vary the elaboration for concepts and command 
syntax. 

In addition to determining whether both syntactic and conceptual information 
benefitted equally from elaborations* we alsu wondered whether benefit from different 
types of elaborations varied as a function of experience. Specifically, would computer- 
experienced users benefit from the same types of elaborations as computer-novices when 
learning to use a new operating system? We expected these two groups to have 
almost complementary needs. Experienced users already understand the general 
concepts behind computer systems. They need to know how those concepts are 
instantiated in the new system and might be distracted and bored by elaborations on 
concepts they already understand and by long expositions on how the commands work. 
Conversely, novices lack a clear conception of what a computer operating system can 
do. They might benefit from a longer discussion of these new concepts. Both 
experienced users and novices, on the other hand, might benefit from seeing concrete 
examples of the command syntax. Although experienced users may be better able to 
parse the standard abstract syntax specifications found in most computer manuals, they 
too should prefer more informative specifications and instances from which to generalize 
the rule. 
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Method 

Design 

The experiment used a 2x2x2 between-subjects factorial design: computer experience 
(experienced vs. novice computer users), conceptual elaborations (present or absent from 
th^ manual), and elaborations of command syntax (present or absent from the manual). 
Subjects were screened for prior computer experience and, if appropriate, were assigned 
to one of the experience groups. Within each experience group, subjects were randomly 
assigned to one of the four manual conditions. 

Subjects 

Seventy-two subjects were each p^ ^ $6 for participating. The 40 novices were 
students or staff members from C-MU, University of Pittsburgh or Allegheny Community 
College who had taken at most one programming course and claimed some familiarity 
with an interactive computer opera, i system, though not one running UNIX. VMS or 
DCS. Tha 40 experienced subjects were graduate students, faculty or staff from C-MU 
or Pitt who knew at least two programming languages and were familiar with either the 
UNIX or VMS operating systems, both of which support subdirectories. The experienced 
subjects also had experience using micro-computers, though not the IBM-PC. 

Materials 

The elaborations in the manuals varied along two dimensions. A manual was 
''Concept Rich" if it contained elaborations on the purpose of the commands and ^^hen 
it was a good idea to use them. Concept-Rich manuals also contained elaborations on 
basic topics such as disk drives, subdirectories and paths. All of these elaborations 
wer$ omitted from the "Concept Poor" versions. A manual was "Syntax Rich" if it 
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contained elaborations on how to issue a command, such as examples of correct 
commands and descriptively rich format statements. These elaborations were omitted from 
the ''Syntax Poor'' version. These variables were combined factorially to create four 
versions of the manuals.^ The b>ntax-Rich elaborations are illustrated in Appendix 3 and 
the Concept-Rich elaborations in Appendix 4. 

Procedure 

The procedure for this study was very similar to that of Experiment 1. except that no 
sub -.(S re given advance information about the tasks before reading the manual. 
Subjects read their assigned manual at their own pace (for a maximum of one hour). 
Subjects were told that since the manual would not be available while they performed 
the task, they should review the important points of the manual as often as time 
permitted. After the reading period was over, the manuals were removed and subjects 
were asked to perform six tasks on the computer to the best of their ability. Since the 
experienced computer-users might give "ceiling* performance on tasks that novices find 
challenging, and that novices might give "floor* performance on tasks that experienced 
subjects find challenging, half the tasks were designed to be relatively easy while the 
other tasks were designed to be relatively difficult. The instructions for the six tasks 
were as follows: 

Task 7. Before you. in drive A. is a diskette containing a number of files. 
Some of these files have the word "PART* in their names, such as file 
"PART.l*. We want you to change the names of these files. The new name 
that you should give each file appears on the first line of th?.t file. So. to find 
the new name, you must inspect the contents of each file that now has 
"PART* in its name and then give the file the name that you find on the first 
line of that file. 

Task 2. Next, you should create two directories on this diskette. One 
directory is to be named PROGRAMS and the other named DATA. Move all 
the files that have the word "Program" in ther names into the PROGRAMS 
directory. And. similarly, move the "Data" filf-^i into the DATA directory. You 
do not want any Program or Data files to remain in the root directory of the 
diskette in drive A. 

ERIC 28 



Reder 



25 



Task 3, The diskette in drive B contains a subdirectory named ''NEW/ We 
would like you to move all of the files in this subdirectory to the root directory 
of the diskette in drive A. You do not want any files to remain -in the directory 
on drive B. 

Task 4 The root directory on th^ diskette in drive A contains three files with 
.OCR extensions and three files with .PRG extensions. Each file matches 
one of the .PRG files in its stem name. That is, the SORT.OCR file 
corresponds to the SORT.PRG file, and so on. We would like you to create 
three new files by appending each .PRO file to the end of the corresponding 
.OCR file. The new files should all have the extension .CEE* So. for < xample 
you will create a file called SORT.CEE which would contain the contents of 
SORT. OCR followed by the contents of SORT.PRG. You should only need to 
issue one command to accomplish this task. 

Task 5 The root directory on the diskette in drive A contains a directory 
called EXP83. EXP83 contains another directory called SUBJ.FLS. We want 
you to create a file called EXP83.LST in the EXP83 directory. The contents of 
this file, EXP83.LST. should be a list of the names of the files in the 
SUBJ.FLS directory. 

Task 6 We want you to eliminate the directory named SOURCE and 
everything it contains from the root directory of the diskette in drive A. 

Tasks 1, 2 and 3 were considered relatively easy, Task 4 required subjects to 
compose a complex command with wildcards. Task 5 required using a variant of the 
COPY command to create a pipe from the keyboard to a file. Task 6 required 
soph^ticated path specifications in commands to operate on deeply embedded files and 
subdirectories. 



Results 

The scoring procedure was the same as that used for Experiment 1. The results 
described below reflect the scores of 72 subjects, ten novice subjects and 8 experienced 
subi^cts in each of the four manual conditions. Experienced subjects took less time to 
read the manual than novices (42 min. vs. 55 min), f{l.64)>i27.0. MS^«113. p<.Ol, 
and manuals that contained conceptual elaborations were read more slowly than those 
that did not (51 min. vs. 46 min,). /=<1,64)-4.0, /VfS,-1l3, p<.05. 
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The classification of tasks as easier and more difficult was validated by the 
significantly better performance for easier tasks than for the more difficult ones. 
• Subjects completed 80% of the easy tasks, compared to only 64% of the hard tasks, 
1,64) -27.0, MS^« 03, p<.Ol. This advantage for the easier tasks was also found for 
the other performance measj.es. 



INSERT TABLE 3 ABOUT HERE 



Table 3 presents the mean percentage of tasks successfully completed as a function 
of task difficulty, experience and types of elaboration. As in Experiment 1, there were 
no significant differences in ability to complete the task as a function of type of 
elaboration. This supports the idea that even our "minimal manuals* were adequate for 
learning to perform the tasks. This "null* result is not caused by "ncisy"' data or 
insensitive measures. The measures were sensitive enough to reveal significant 
differences in completion due to difficulty of task (as reported earlier), and differences in 
successful performance as a function of prior experience, f\1,64)s24.2S. MS^«.08, 
p<.Ol. There is a suggestion that conceptual elaborations interfered for novices, but 
this effect was not reliable. 

Although there were main effects of experience on all measures of performance, 
experience did net interact with manipulations of manual content.^ Similarly, the variable 
of task difficulty produced significant results, but did not interact with any of the 
variables of interest. Therefore, we have collapsed over experience and task difficulty in 
our description of the remaining results. Table 4 presents results from Experiment 2 
using the same measures as those presented in Table 1 for Experiment 1. The data 
are presented as a function of whether or not the manual contained concept 
elaborations and whether or' not it contained syntax elaborations. 
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INSERT TABLE 4 ABOUT HERE 



The same pattern emerges in all these measures: facilitation when syntax 
elaborations are present, but no effect from conceptual elaborations. Subjects who saw 
the syntax elaborations were marginally faster than those who did not. ^1.64) -2.84. 
M$^«319, P<.10, Subjects issued significantly fewer commands when the manual 
contained syntactic elaborations. ^1,64) «S.7. MS^«100S. p<,OS. As in the first 
experiment, we computed the mean number of commands for a completed task as a 
proportion of the minimum number required. There is a significant effect of syntactic 
elaborationr* ^1,56) -6.69. MS^«4. p<.OS. but no effect of conceptual elaborations.^ 

GENERAL DISCUSSION 

In both Experiments 1 and 2. elaborations improved the quality of skill performance. 
In Experiment 1. performance was least efficient when the manual did not contain any 
elaborations and the subjects did not know in advance what tasks they would be asked 
to perform. In Experiment 2. performance was again least efficient v^hen the manual 
contained no elaborations. This was true regardless of prior computer experience and 
regardless of the difficulty of the required tasks. 

Two versions of the manuals used in Experiment 2 were essentially identical to those 
used in Experiment 1. The version without any type of elaboration contained few 
changes from the original, unelaborated version. Similarly, the manual that contained 
both syntax and the concept elaborations was essentially the same as the elaborated 
manual in Experiment 1. By creating two new versions, one with only syntax 
elaborations, and one with only concept elaborations, we were able f) determine whether 
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both types of elaborations contributed equally to the new result that author-provided 

elaborations help in a skili-learning situation. We found that only the syntactic 
elaborations systematically improved performance. 

We began this paper by suggesting that elaborations might help in a skill acquisition 
situation even though they do not seem to facilitate performance in a declarative 
knowledge test. The reason, we argued, was that conceptual elaborations might help 
subjects figure out which procedure to use in a novel situation. We also expected 
syntactic elaborations and examples to help subjects figure out how to issue specific 
commands to the computer. The data support the idea that syntactic eliborations help 
people figure out exactly how to implement a procedure. The useful elaborations were 
those that explained the syntactic notation and illustrated how syntactically con'ect 
commands should look; without these elaborations, subjects had to rely exclusively on 
abstract syntactic rules. 

Despite the failure to show facilitation from concept elaborations, it seems that the 
benefit of elaborations goes beyond getting the syntax right in issuing commands. Vie 
pattern of errors and specific use of commands from the analysis of the on-line 
protocols in Experiment 1 suggests that subjects got more out of the text generally when 
the documentation was elaborated (see Table 2). 

An important que^ition that remains is why the syntax examples h3lped performance 
to the exclusion of the concept elaborations. Perhaps the syntax examples more closely 
matched what the subject needed to do. The concept elaborations were not written with 
any specific task in mind. Although the elaborations on command syntax were also not 
written with a particular task in mind, many of the commands described in the manual 
were tested by the tasks. Conceivably, if the mapping between the concept examples 
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and the task requirements were as close as the map between the syntax examples and 
the task requirements, performance would also benefit from the conceptual elaborations. 



Consistent with this view, Ross (1984) has shown that performance in a nevi skill 
domain is influenced by pr<or e.:amples when these examples match on superficial 
features. It appears that "remindings'' to prior examples depend more on the closeness 
of superficial features of the example than the appropriateness of the example. PiroUi 
and Anderson (in press) report a study on learning LISP which indicates that it is not 
the example per se that heips performance, but whether the example is used to illustrate 
how to do the task rather than simply ciarifying what happens when a procedure is 
used. 

The Procedural/Declarative Knowledge Distinction Revisited 

Given the result that only syntactic elaborations facilitated performance, the question 
naturally arises as to whether elaborations have a different status for learning a skill than 
for learning facts or whether syntactic elaborations help performance, regardless of the 
nature of the task, while other types do not. In order to answer this question, we 
conducted a replication of Experiment 2. substituting a declarative /.nowledge test for the 
skill learning test. 

The declarative knowledge test consisted of 24 true-false questions such as The 
RMDIR command can be used to delete any directory, including the root directory (False), 
and When typing the location information lor the parameters In your commar)ds, do riot 
leave spaces t>et^een the drive and path specificatioris [True]. The questions were written 
with the intention that they not require subjects to recognize contexts of application of a 
fact, but rather depetid on the subject's ability to retrieve studied facts from memory. 
In order to reduce the possibility that prior knowledge would affect performance on this 
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test, given that it only required a binary decision, we pre-tested the questions with 
subjects who had not read the manuals. We asked 43 people to answer the true-false 
questions and discarded any question whose accuracy was below 25 or above 75 
percent correct. 

In the experiment, 32 subjects were run In groups of 10 to 12, and were randomly 
assigned to one of the four instructional conditions. All subjects were inexperienced 
computer users who had taken at most one programming course. They were allowed to 
read the manual at their own pace for up to one hour. After they finished studying the 
manual, they were given the true-false test on a sheet of paper. They were given 
unlimited time to complete the test, but most finished in about 10 minutes. The entire 
experiment lasted about 75 minutes (with subjects averaging about 50 minutes to read 
the document and the rest of the time spent on instructions and administrative material). 

The results of the trje-false test ' presented in Table 5 as a function of the 
extent of syntactic and conceptual elaboration. The differences among conditions are 
quite small and there are no main effects or interactions. It seems that the 
documentation does not produce the same effect when the test taps declarative rather 
than procedural knowledge. That Is, subjects who studied manuals containing syntactic 
elaborations did not out-perform subjects in the other conditions. On the other hand, 
the results do not show the same pattern as that found by Reder and Anderson when 
they looked at fact learning as a function of extent of elaboration. That Is, subjects 
who saw the unelaborated manual did not perform better than subjects who read the 
longer, elaborated manuals. 
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A reasonable conclusion from this pattern of results is that the advantage of 
elaborations found in Experiments i and 2 was not due to the performance measure per 
se. That is. the conjecture made earlier that elaborations help procedural knowledge but 
not declarative knowledge has not received much support. A more likely conclusion is 
that the benefit or liability of elaborations is a function of their quality and relevance to 
the main points that they support. 

• 

In summary, this research shows that the findings of Reder and Anderson (1980. 
1982) do not extend to the domain of skill acquisition; however, the advantage of 
elaborations seems to be restricted to providing the reader with explanations and 
concrete illustrations of how the skill is performed. At this time there is little evidence 
that other types of author-provided elaborations are beneficial to skill learning. On the 
other hand, this conclusion may be affected by the nature of the commands being 
taught and the tasks being tested. Appropriate command use requires that the user 
know when to use the command and how to use the command. The latter requirement 
was facilitated by syntactic elaborations while the conceptual elaborations did not help 
the former. It may have been that the applicability issues were trivial in this task and 
could not benefit from conceptual elaborations. Alternatively, if the syntax of the 
commands were more familiar, the syntactic elaborations may not have been as 
facilitating. 
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APPENDIX 1 

The Commands Taught in the User's Manual 



COMMAND 

DIR 

MKOIR 

CHOIR 

RMOIR 

TYPE 

RENAME 

COPY 

ERASE 



FUNCTION 

List the files in a directory 

Create (or ''make'') a subdirectory 

Change default directory assignment 

Eliminate (or "remove") a subdirectory 

Display the contents of a file 

Change the name of a file 

Create a duplicate copy of a file 
Combine or append files together 
Transer data between system devices 

Eliminate a file 



•Numlock 
•Break 



Freeze the screen 

Abort the current command 

Change the default drive assignment 



ERLC 



36 



Reder 



33 



APPENDIX 2 

Samples of four types of elaboration 
from the manual used in Experiment 1 



Meta-statom«nt 

UNELABORATED 



ELABORATED 

Sinc^ the computer has two disk drives 
which can each contain a diskette, you 
must specify whetOtr the file you want 
is in drive A or drive B wtien you 
give the computer a commend. It your 
command doesnl specify which drive 
contains the file, the computer 
automatically assunnes that it can find 
the file in the "default* drive. The 
next section explains what the "default 
drive* is, and how to tell the computer 
to look on a different drive if 
necessary. 



Since the computer has two disk 
drives which can each contain a 
diskette, you must specify 
whether the file you want is in drive 
A or drive B when you give the 
computer a comnfiand. If your 
command doesn't specify which 
drive contains the file, the 
computer automatically assumes 
that it can find the file in 
the "default* drive. 



ELABORATED 

The B: ("B-colon") in the command 
stands for the right-hand disk drive. 
The colon signals the computer that 
the letter or word preceding it is a 
"device" rather than the name of a 
command or file. Devices are pieces 
of computer hardware, such as disk 
drives, a printer or even the keyboard. 
After you enter the command, the B> 
prompt will appear on the screen. 
From now on the computer will 
automatically look for files on drive B. 



UNELABORATED 

The B: in the command stands for 
the right hand disk drive. From 
now on. the B> prompt appears on 
the screen and the computer will 
automatically look for files on 
drive B. 
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Analogy 



ELABORATED 



UNELABORATED 



When you give the computer a command 
concerning a file, such as TYPE, ERASE 
or COPY, the computer looks for the 
file on a "diskene/ A diskette, also 
known as a "floppy disk/ is similar 
to a small, flexible phonograph record 
record, except that instead of storing 
sounds, it contains information which 
the computer can read, add to or delete. 
All the files you create on the computer 
are stored on diskettes. So, in order 
to work on your tJes, you must insert 
the diskette that contains them into 
the computer. You insert a diskette 
into one of the two ''disk drives'* on 
the front of the computer cabinet. The 
drive on the left is called drive A, 
and the one on the right is drive B. 



When you give the computer a 
command concerning a file, such as 
TYPE, ERASE or COPY the computer 
looks for the file on a "diskette." 
To use a diskette, you insert it ^«ito 
one of the two "disk drives" on the 
front of the computer cabinet. 
The drive on the left is called 
drive A, and the one on the right 
is drive B. 
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(Appendix 2. continued) 



Example 

The elaborated and unelaborated versions 
are for the most part identical except for 
the addition of the example (italicized here) 

Using COPY to Combine Files 

You can use COPY to combine files, appending a copy of one file to the end of another 
file. 

FORMAT 

The format of the command is: 

COPY [Loc & narre first file ^ next file + ...l [Loc & name combined file] 

(Loc & name first flle^nexi file...] refers to a list of the files you want to "add'' together. 
The names of the files are typed with plus (^) signs between them. You need to specify 
location information for each filename in the list in the usual jway. with drive and path 
specifications. When several filenames are listed in this manner, the COPY command 
results in a new file in which the contents of the first file on the list appear first, followed 
by the contents of the second file, then the contents of the third file and so on. So be 
sure that the files in the list appear In the order in which you want them combined. 

[Combined file] refers to the new file that will contain the combined files; what you want to 
call this file, and where in the directory structure you want it to go. Specify the location 
in terms of a drive and a path to a directory as usual. Type the name you would like to 
give the file at the end of the path. 

For example^ suppose you write a report in sections, with each section in a separate file. 
You want to format ana print the report as one file, so you combine the sections into one 
file. The following command takes three files, //vrflO.AfSS, BODY.MSS, and CONCLMSS and 
combines them into a new file called REPORT: 

A> COPY B.'INTRO.MSS'^B.BODY.MSS'^B CONCLMSS REPORT <ENTER> 
The combined file, REPORT will consist of the introduction, the body and the conclusion. 



39 



Reder 



Appendix 3 



36 



Excerpt of manual from Experiment 2 
illustrating RICH SYNTAX Elaborations 

CHANGING THE CURRENT DIRECTORY - CHDIR 

The CHDIR command allows you to designate a directory as the ''current* directory for a 
drive, so that the computer will automatically look there for files or subdirectories 
mentioned in your commands. You can designate a current directory for each disk dfive 
Independently. 

FORMAT 

CHOIR (IOC and name of new current directory] 
You can use the abbreviation CD in the command instead of typing CHDIR. 

[Location of new current directory] refers to the path to the directory you want to 
designate as the new current directory. The last directory name on the list should be the 
name of the directory you want to designate. 

For example, the command below designates a subdirectory called PASCAL as the new 
current directory in drive B: 

A> CHDIR B:\PROGRAMS\PASCAL < ENTER > 

The first symbol in the path is a backslash (\). This means that the path to the new 
current directory starts with the root directory of the diskette in drive B. The path indicates 
that the root directory contains a subdirectory called PROGRAMS, and that PROGRAMS 
contains PASCAL, the directory you want to designate as the "new* current directory. As 
usual, the infiount of location information you need to provide depends, on which directory 
was last designated as the current directory for the drive. 

To change the current directory back to the root directory, give a command like tne 
following: 

A> CHDIR B:\ < ENTER > 

The backslash (\) in the commands above symbolize the root directory. So the command 
above changes the current directory for drive B to the root directory. 

If you forget which directory is the current directory, the computer can remind you. Enter 
a CHDiR command without specifying a location. The computer will display the path from 
the root directory to the current directory or a backslash if you are still In the root 
directory. 
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Excerpt of manual from Experiment 2 
illustrating RICH CONCEPT Elaborations 

CHANGING THE CURRENT DIRECTORY - CHDIR 

The CHDIR command (short for "change directory'') allows y^u to designate a directory as 
the ''current'' directory for a drive so that the computer will automatical!/ look there for 
files or subdirectories mentioned in your commands. You can designate a curront directory 
for each disk drive independently. Changing the current directory on the di3 tte in o.iv9 
A does not affect the current directory on d'ive B. 

The root directory is automatically designated as the current directory for eac i drive when 
you first start up the computer. It is useful to designate a subdirectory as the current 
directory when you will be working primarily on the flies in that subdirectory. Then you 
won't h&ve*to specify the path to the subdirectory in each command you issue. 

FORMAT 

The format of the command is: 

CHDIR ((d:!path] 

You can use the abbrr'/iation CD in the command instead of typing CHDIR. 

If you designate a sub( jtory as the new current directory, the. computer will carry out all 
the subsequent commands within .that directory, unless you specify a path to another 
directory. To change the current directory back to the root directory, use a backslash as 
the path. 

If you forget which directory is the current directory, the computer can remina you. Enter a 
CHDIR command without specifying a IccaJon. The computer will display the oath from 
the root directory to the current directory, or "V, if you are still in the root directory. 
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Notes 

^DoolinQ & Cristiaansen (1977), for example, explored to what extent the false alarms 
were due simply to response bias as opposed to differential encoding. Although part of 
the effects are due to response bias, part of the result is clearly due to encoding 
differences. 

^Glover and his colleagues (Phifer, McNickle, Ronning & Glover, 1983) found that thB 
summaries produced worse performance than the elaborated texts if subjects were given 
a small, fixed amount of time per sentence. The sentence presentation rate for a 
subject was the average r?M at which he or she read sentences from a novel. Under 
these circumstances, the subjects could not comprehend the summaries and their 
performance suffered. As described above, Reder and Anderson (1982) also equated 
reading time per sentence, but used a much slower presentation rate; under these 
conditions, performance was much better without elaborations. 

^Essay exams do not ffiW into the category o^ declarative tests as we are defining 
them. Writing an essay clearly calls for a deep understanding of a body of information 
and for selecting appropriate items from among the relevant facts. 

^e wish to distinguish here between the type of skill required to use an IBM-PC, 
and the type of skill required to follow a set of instructions for assembling a device or a 
piece of machinery. The latter does not require recognizing contexts of application. 

^The syntax in DOS is fairly intransigent. While there has been some attempt recently 
to develop operating systems and programming languages that tolerate misspellings, 
substitution of synonyms, variable order of arguments, etc. (e.g., Barnard et al, 1981), 
learning to use highly rigid syntactic rules is still an extreTiely common requirement. 
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second independent judge, coded a random sample of the protocols. The 

agreement between the two judges was quite high (r« 10); ^ny disagreements were 
resolved to mutual satisfaction. 

^The word counts in the four versions were as follows: both Concept-Rich and 
Syntax-Rich elaborations. 10.686 words; only Concept-Rich elaborations. 8.366 words; only 
Syntax-Rich elaborations. S.699 words; No elaborations. 3.428 words. 

^It is unlikely that the lack of an interesting result due to expertise is due to our 
novices having had some computer experience. We found that novices who had no 
background whatsoever could not even begin to perform the tasks of the experiment 
causing a ''ftoor effect" among the conditions. We selected subjects for the novice 
condition that we feit were as inexperienced as possible to participate in the experiment. 

^he degrees of freedom differ for the completed t?sks measures because some 
subjects did not successfully complete any tasks. 

^^e would like to thank an anonymous reviewer for making this point. 
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Performance on Task as a Function of When Task Instructions 
Were Given and Type of Manual Studied. Experiment 1. 



BEFORE 



Proportion of 
Tasks Correctly 
Coaplttt«d 

HMD TlM on 
Task In Nlnut«8 
(all tasks) 

Maan Nuabar of 
Conands Issued 
(all tasks) 



Elaborated 
Manual 



.80 



33.5 



95.8 



Proportion of 

(^■aands Issued 

Per Miniaua Step 2.88 

Required 

(coapleted tasks only) 



Unelaoorated 
Manual 



.80 



36.1 



94.2 



2.34 



AFTER 

Elaborated C^laborated 
Manual Manual 



.85 



29.4 



76.8 



2.29 



.76 



40.2 



101.8 



3.23 
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Table 2 



Mean Steps Per Subject for Five Kinds of Actions as a Function of 

Version of Manual. 



Elaborated Manual Unelat)orat«d Manual • . 



Productive Moves 27.7 steps 33.7 steps 

Verification Moves 11.0 12. 3 

Execution Errors 9.5 20.2 

Goal Specif. Errors 7.3 13.5 

Recovery Moves 11. 3 20.8 
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Table 3 



Percentage of Tasks Successfully Completed as a Function of 
Experience, Task Difficulty, and Type of Elaborations, Experiment 2. 



SYNTAX RICH 



SYNTAX POOR 



EASY TASIS 

NoviCM 

Exp0rlenc«d 
UMrs 

HARD TASKS 

Novices 

Experienced 
Users 

MEAN 

Novices 

Experienced 
Users 



Concept 
Rich 



.64 
.95 



.47 
.89 



.55 
.91 



Concept 
Poor 



.73 
1.00 

.58 
.87 

.65 
.95 



Concept 
Rich 



.61 
.95 

.41 
.90 

.54 

.92 



Concept 
Poor 



.71 
.91 

.41 
.72 

.61 
.84 
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Table 4 



Performance on Task as a Function of Type of 
Elaboration-Availability in the Manual. 



SYNTAX 

Concept 
Rich 

Hean TIm on 

Task In Hlnutes 37.4 
(all tasks) 

Hean Nuabar of 

Coaaands Issuad 71.7 
(all tasks) 

Proportion of 
Coaaands Issuad 

Per NlnlauB Step 3-5 
Raqulred (coaplatad 
tasks only) 



RICH SYNTAX POOR 

Concapt Concapt Concept 

Poor Rich Poor 

37.7 43.5 45.9 

73.7 88.7 92.4 

3.5 4.5 5.3 
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Table 5 



Mean Percent Correct on True/False Questions that Tested Materials 

Used in Exp riment 2. 

Concept Concept 
Rich Poof 

SYNTAX RICH .68 .63 

SYNTAX POOR .65 .61 



53 



Camegie-Mellon University/Reder & Charney 

Dr. Robert Ahlers 
Code N711 

Huaan Factors Laboratory 
NATTRAEQUIPCEM 
Orlando, FL 32813 

Dr. Ed Aiken 

Mavy Personnel R&D Center 
San Diego, CA 92152 

Dr. Earl A. Alluisi 
HQ, AFHRL (AFSC) 
Brooks AFB, TX 78235 

Technical Director, ARI 
5001 EisenhoHer Avenue 
Aleiandria, VA 22333 

Dr. Meryl S. Baker 

Navy Personnel R&D Center 

San Diego, CA 92152 

Dr. Menucha Birenbaua 
School of Education 
Tel Aviv University 
Tel Aviv, Raaat Aviv 69978 
ISRAEL 

Dr. Gautaa Bisnas 
Depart ent of Coaputer Science 
University of South Carolina 
Coluabia, SC 29208 

Dr. John Black 
Yale University 
Box 11A, Tale Station 
New Haven, CT 06520 

Arthur S. Blaines 
Code N711 

Naval Training Equipaent Center 
Orlando, FL 32813 

Dr. Robert Blanchard 
N^vy Personnel R&D Center 
San Diego, CA 92152 

Dr. Richard Braby 
NTBC Code 10 
Orlando, FL 32751 



1985/08/28 

Dr. Robert Breaux 
Code N-095R 
NAVTRAEQUIPCEN 
Orlando, FL 32813 

Dr. Ann Brown 

Center for the Study of Reading 
University of Illinois 
51 Gerty Drive 
Chaapaign, IL 61280 

Dr. Patricia A. Butler 
NIE Nail Stop 1806 
1200 19th St., NH 
Hashirjton, DC 20208 

Dr. Robert Calfee 
School of Education 
Stanford Uhiversity 
Stanford, CA 94305 

Dr. Pat Carpenter 
Carnegie«-Nellon University 
Departaent of Psychology 
Pit;tsburgh, PA 15213 

Dr. Robert Carroll 
NAVOP 01B7 

Washington, DC 20370 

Dr. Fred Qiang 

Navy Personnel R&D Center 

Code 51 

San Diego, CA 92152 

Dr. Davida Charney 
Departaent of Psychology 
Carnegie-Nellon University 
Schenley Park 
Pittsburgh, PA 15213 

Dr. Eugene Charniak 
Brown University 
Coaputer Science Departaent 
Providence, RI 02912 

Nr. Rayaond E. Christal 
AFHRL/NOE 

Brooks AFB, TX 78235 



54 



Carnegie-Mellon Unlversity/Peder & Charney 



1985/08/28 



Director, 

HanpoMer Support and 

Readiness Prograa 
Center for Haval Analysis 
2000 North Tdauregard Street 
Alexandria, VA 22311 

Chief of Naval Education 

and Training 
Liaison Office 

Air Force Uu»M Resource Laboratory 
Oraratlons Training Division 
Vllllans AFB, AZ 85224 

Assistant Chief of Staff 
for "Research, Developaent, 
Test, and Evaluation 

^val Education and 
Training Conand (N-5) 

NAS Pensacola, FL 325u, 

Dr. Stanley Collyer 
Office of Naval Technology 
aoo V. Qulncy Street 
Aril igtc.<, 7A 22217 

Dr. Mary Cross 
Deparcaent of Education 
Adult Literacy Initiative 
Rooa 4145 

400 Maryland Avenue, SH 
Washington, DC 20202 

CTB/McGraH«Hlll Library 
2500 Garden Road 
Monterey, CA 93940 

CDR M5ke Cur ran 
Office of Naval Research 
wOO H. Qulncy St« 
Code 270 

Arlington, VA 22217-5000 

Bryan Dallaan 
AFHRL/LRT 

Lowry AFB, CO 80230 

Dr. Sharon Derry 
Florida State University 
Depertaent of Psychology 
Tallahassee, FL 323O0 



Defense Technical 

Inforaatlon Center 
Caaeron Station, Slug 5 
Alexandria, VA 22314 
Attn: TC 
(12 Copies) 

Or. ThOKS M. Duffy 
Couunloatlons Design Center 
Carnv^gle-Mellon University 
Sohenley Park 
Pittsburgh, PA 15213 

Dr. Richard Dutcui 
University of California 
Santa Barbara, CA 93106 

Barbara Ba<<^n 
Military Educator^s 
Resource Metnork 
InterAaerioa Research Associates 
1555 Vilson Blvd 
Arlington, VA 22209 

Edward E. Eddoms 
CNATRA N301 
Naval Air Station 
Corpus Christi, TX 78419 

Dr. John mis 

Navy Personnel R&D Center 

San Diego, CA 92252 

Dr. Jeffrey Elaan 
University of California, 

Sar Diego 
Departaent of Linguistics, C-008 
U Jolla, Zk 92093 

Dr. Richard Elster 
Deputy Assistant Secretary 

of the Navy (Manpower) 
OASN (M&RA) 

Departaent of the Navy 
Vishington, DC 20350-1000 

Dr. Susan Eabretson 
University of Kansas 
Psychology Departaent 
Lawrence, KS 66045 



Carnegie-Melion University/Reder & Charney 



1985/08/28 



Dr. Randy Engle 
Departnent of Psychology 
Onlveralty of South Carolina 
Coluibla, SC 29208 

Dr. HllllaB Epstein 
University of Wisconsin 
V. J. Brogden Psychology Bldg. 
1202 W. Johnson Street 
Hadlson, HI 53706 

ERIC Faclllty«>Acqulsltlons 
4833 Rugby Avenue 
Bethesda, ND 20014 

Edward Esty 

Departaent of Education, DERI 
MS 

1200 19th St. t NW 
Washington, DC 20208 

Mr 9 Wallace Feurzelg 
Educational Technology 
Bolt Beranek & Newaan 
10 Noulton St. 
Caabrldge, MA 02238 

Dr. Gerhard Fischer 
University of Colorado 
Departaent of Coaputer Science 
Boulder, CO 80309 

Dr. Linda Flower 
Carnegie-Mellon University 
Departaent of English 
Pittsburgh, PA 15213 

Dr. Carl H. Frederlksen 
McGlll University 
3700 McTbvlsh Street 
Montreal, Quebec H3A 1Y2 
CANADA 

Dr. John R. Frederlksen 
Bolt Beranek & Newaan 
50 Moalton street 
Caabrldge, MA 02138 

Dr. R. Edward Gelselaan 
Departaent of Psychology 
University of California 
Los Angeles, CA 90024 



Dr. Arthur M. Glenberg 
University of Wisconsin 
W. J. Brogden Psychology Bldg. 
1202 W. Johnson Street 
Madison, WI 53706 

Dr. Saa Glucksberg 
Princeton University 
Departaent of Psychology 
Green Hall 

Princeton, NJ 08540 

Dr. Joseph Goguen 
Coaputer Science Laboratory 
SRI International 
333 Ravenswood Avenue 
Memo Park, CA 94025 

Dr. Susan Goldaan 
University of California 
Santa Barbara, CA 93106 

Dr. Sherrle Gott 
AFHRL/MODJ 

Brooks AFB, fl 78235 

Cr. Richard H. Granger 
Departaent of Coaputer Science 
University of California, Irvine 
Irvine, CA 92717 

Dr. Wayne Gray 
Aray Research Institute 
5001 Elsenhower Avenue 
Alexandria, VA 22333 

Dr. Henry M. Halff 
Ha?ff Resources, Inc. 
4918 33rd Road, North 
Arlington, Vii 22207 

Dr. Ifency F. Halff 
Halff Resources, Inc. 
4918 33rd Road, North 
Arlington, VA 22207 

Dr. Cheryl Haael 
NTEC 

Orlando, FL 32813 



ERIC 



56 



Carnegie-Mellon University/Reder & Charney 



1985/08/28 



Dr. Ray Hannapel 
Scientific and Engineering 
Personnel and Education 
National Science Foundation 
Haahington, DC 20550 

Ha. Carol S« Hargan 
Hanager 

Instructional Videodisc Group 
HunRRO 

1100 5. Washington 
Alexandria, VA 22314 

Nr. Villiaa Hartung 
PEAN Product Nanager 
Aray Research Institute 
5001 Elsenhower Avenue 
Alexandria, VA 22333 

Dr. Itoyne Harvey 
SKI International 
333 RavensMood Ave. 
Rooa B-S32i| 
Nenlo Parkt CA 94025 

Prof. John R. Hayes 
Carnegie-Hellon University 
Departaent of Psychology 
Schenley Park 
Pittsburgh, PA 15213 

Dr. Jean I. Heller 
505 Haddon Road 
Oakland, CA 94606 

Dr. Nelissa Holland 

Aray Research Institute for the 

Behavioral and Social Sciences 
5001 Eisenhower Avenue 
Alexandria, VA 22333 

Dr. Clawle Janvier 

Directeur, CIRADE 

Unlversite* du Quebec a Montreal 

Montreal, Quebec H3C 3P8 

CANADA 

COL Dennis V. Jarvi 

Coaaander 

AFHRL 

Brooks AFB, TX 78235-5601 



Margaret Jeroae 

c/o Dr. Peter Chandler 

83 f The Drive 

Hove 

Sussex 

UNITED KINGDOM 

Dr. Joseph E. Johnson 
Assistant Dean for 
(b<aduate Studies 
College of Science & Matheaatics 
Ohiversity of South Carolina 
Coluabia, SC 29208 

Col. Ooainique Jouslin de Noray 
Etat-Najor de l*Araee de Terre 
Centre de Relations Huaaines 
3 Avenue Octave Greard 
75007 Paris 
FRANCE 

Dr. Marcel Just 
Carnegie--Mellon Ohiversity 
Departaent of Psychology 
Schenley Park 
Pittsburgh, PA 15213 

Dr. Richard Kern 
Aray Research Institute 
5001 Eisenhower Avenue 
Alexandria, VA 22333 

Dr. David Kieras 
Oniversity of Michigan 
Technical Coaaunication 
College of Engineerf.ng 
1223 H. Engineering Building 
Ann Arbor, MI 48109 

Dr. Peter Kincaid 
Training Analysis 

& Evaluation Croup 
Departaent of the Kavy 
Orlando, FL 32813 

Dr. Halter Kintsch 
Departaent of Psycholo^ * 
Uhiversity of Colorado 
Caapus Box 345 
Boulder, CO 80302 



ERIC 



57 



Carnegie-Mellon University/Reder & Charney 



1985/08/28 



Dr. David Klahr 
Cai**N^gle-Hellon University 
Departaent of Psychology 
Schenley Park 
Pittsburgh, PA 15213 

Dr. Mazle Knerr 
Prograa Manager 
Training Research Division 
HuaRRO 

1100 S. Washington 
Alexandria! VA 22314 

Dr. Janet L. Kolodner 
Georgia Institute of Technology 
School of Inforaatlon 
& Coaputer Science 
Atlanta, GA 30332 

M. Diane Langston 
Coaaunlcatlons Design Center 
Carnegle^Mellon University 
Schenley Park 
Plt>3burgh, PA 15213 

Dr. Robert Lawler 
Inforaatlon Sciences, FPX 
GTE Laboratories! Inc. 
40 Sylvan Road 
Walthaa, MA 02254 

Dr. Alan M. Lesgold 
Learning R&D Center 
University of Pittsburgh 
Pittsburgh, PA 15260 

Dr. Alan Leshner 
Deputy Division Director 
Behavioral and Neural Sciences 
National Science Foundation 
1800 G Street 
Washington, DC 20550 

Dr. Clayton Lewis 
University of Colorado 
Departaent of Coaputer Sclonce 
Caapus Box 430 
Boulder, CO 80309 

Dr. Charlotte Llnde 
SRI International 
333 RavensHOod Avenue 
Menlo Park, CA 94025 



Dr. Marda C. Linn 
Lamrence Hall of Science 
University of Cnllfornla 
Berkeley, CA 94720 

Dr. Wllllaa L. Naloy 
Chief of Naval Education 

and Training 
Naval Air Station 
Pensacola, FL 32508 

Dr. Manton M. Matthews 
Dopartaent of Coaputer Science 
University of South Carolina 
Coluabla, SC 29208 

Dr. Richard E. Mayer 
Departaent of Psychology 
University of California 
Santa Barbara, CA 93106 

Dr. Jaaes McBrlde 
Psychological Corporation 
c/o Rarcourt, Brace, 

Javanovlch Inc. 
1250 Nest 6th Street 
San Diego, CA 92101 

Dr. Joe McLachlan 

N^vy Personnel R&D Center 

San Diego, CA 92152 

Dr. Jaaes McMlchael 
Navy Personnel R&D Center 
San Diego, CA 92152 

Dr. Barbara Means 
Huaan Resources 

Research Organization 
1 100 South Washington 
Alexandria, VA 22314 

Dr. Arthur Melaed 

U. S. Departaent of '^'^ucatlon 

724 Brown 

Washington, DC 20208 

Dr. George A. Miller 
Departaent of Psychology 
Green Hall 
Princeton University 
Princeton, NJ 08540 



58 



Carnegie-Mellon University/Reder & Charney 



1985/08/28 



Dr. Lance A. Miller 
IBM Thoias J. Watson 

Research Center 
P.O. BOK 218 

Yorktown Heights, NT 10598 

Dr. Andrew R. Molnar 
Scientific and Engineering 
Personnel and Education 
National Science Foundation 
Washington, DC 20550 

Dr. WiUiaa Montague 

NPROC Code 13 

San Diego, CA 92152 

Dr. Toa Noran 
Xerox PARC 

3333 Coyote Hill Road 
Palo Alto, CA 94304 

Dr. Allen Nunro 
Behavioral Technology 
Laboratories - USC 
1845 S. Elena Ave., 4th Floor 
Redondo Beach, CA 90277 

Spec. Asst. for Research, Experi- 
■ental & Acadeaic Programs, 
NTTC (Code 016) 

NAS Meaphis (75) 

HiUington, TN 38054 

Assistant for MPT Research, 
Developaent and Studies 
NAVOP 01B7 

Washington, DC 20370 

Assistant for Personnel 

Logistics Planning, 

NAVOP 987H 
5D772, The Pentagon 
Washington, DC 20350 

Dr. Donald A. Noraan 
Institute for Cognitive Science 
University of California 
U Jolla, CA 92093 

Director, Training Laboratory, 

NPRDC (Code 05) 
San Diego, CA 92152 



Director, Manpower and Personnel 

Laboratory, 

NPRDC (Code 06) 
San Diego, CA 92152 

Director, Huaan Factors 

ft Organisational Systeas Lab, 

NPRDC (Code 07) 
San Diego, CA 92152 

Library, NPRDC 

Code P201L 

&U1 Diego, CA 92152 

Coaaanding Officer, 

Ifatval Research Laboratory 
Code 2627 

Washington, DC 20390 

Dr. Harry F. O'Neil, Jr. 
Training Research Lab 
Aray itesearch Institute 
5001 Eisenhomr Avenue 
Alexandria, VA 22333 

Office of Naval Research, 

Cod€ 442EP 
800 N. Quincy Street 
Arlington, VA 22217-5000 

Office of Naval Research, 

(k)de 442PT 
800 N. Quincy Street 
Arlington, VA 22217-5000 
(6 Copies) 

Psychologist 

Office of Naval Research 
Branch Office, London 
Box 39 

FPO New York, NY 09510 

Special Assistant for Marine 

Corps Matters, 

ONR Code 100H 
800 N. Quincy St. 
Arlington, VA 22217-5000 

Psychologist 

Office of Naval Research 
Liaison Office, Far East 
APO San Francisco, CA 96503 



59 



Carnegie-Mellon University/Reder & Charney 



1985/08/28 



Or. Judith Oraaanu 
Any Research Institute 
5001 Eisenhower Avenue 
Alexandria, VA 22333 

Dr. Jesse Orlansky 
Institute for Defense Analyses 
1801 M. Beauregard St. 
Alexandria, VA 22311 

Lt. Col. (Dr.) David Payne 
AFHRL 

Brooks AFB, TZ 78235 

Dr. Douglas Pearse 

DCIEM 

Box 2000 

DoNnsview, Ontario 
CANADA 

Dr. Nancy Pennington 
University of Chicago 
Graduate School of Business 
1101 E. 58th St. 
Chicago, IL 60637 

Military Assistant for Training and 

Personnel Technology, 

OUSD (R & E) 
Rooi 3D129, The Pentagon 
Washington, DC 20301 

Dr. Ray Perez 

ARI (PERI-II) 

5001 Eisenhower Avenue 

Alexandria, VA 2233 

Adainistrative Sciences Department, 

Naval Postgraduate School 
Monterey, CA 93940 

Dr. Steven Pinker 
Departaent of Psychology 
E10-018 
M.I.T. 

Caabridge, HA 02139 

Dr. TJeerd Ploap 

Twente University of Technology 

Departaent of Education 

P.O. X 217 

7500 AE ENSCHEDE 

THE NETHERLANDS 



Dr. Martha Poison 
Departaent of Psychology 
Caapus Box 346 
University of Colorado 
Boulder, GO 80309 

Dr. Peter Poison 
University of Colorado 
Departaent of Psychology 
Boulder, GO 80309 

Dr. Steven E. Poltrock 
MCC 

9430 Research Blvd. 
Echelon Bldg #1 
Austin, TX 78759-6509 

Dr. Joseph Psotka 
ATTN: PERI-1C 
Aray Research Institute 
5001 Eisenhower Av^. 
Alexandria, VA 22333 

Lt. Joae Puente Ontanilla 
C/Santislaa Trinidad, 8, 4 E 
28010 Madrid 
SPAIN 

Dr. Lynne Reder 
Departaent of Psychology 
Carnegie-Mellon University 
Schenley Paik 
Pittsburgh, PA 15213 

CDR Karen Reider 
Naval School of Health Sciences 
National Naval Medical Center 
Bldg. 141 

Washington, DC 20814 

Dr. Fred Reif 
Physios Departaent 
University of California 
Berkeley, CA 94720 

Dr. Lauren Resnick 
Learning R&D Center 
University of Pittsburgh 
3939 O'Hara Street 
Pittsburgh, PA 15213 



60 



Carnegie-Mellon University/Reder & Charney 



1985/08/28 



Dr. Jeff Richardson 
Denver Research Institute 
University of Denver 
Denver, CO 80208 

Wllllaa Rlzzo 

Code 712 NAVTRAEQUIPCEN 

Orlando, FL 32813 

Dr. Andrew M. Rose 
uMrlcan Institutes 

for Research 
1055 Thous Jefferson St., NW 
Iteshlngton, DC 20007 

Dr. Ernst Z. Rothkopf 
AKT Bell Laboratories 
RooB 2D-456 
600 Mountain Avenue 
Murray Hill, MJ 07974 

Dr. Wllllaa B. Rouse 

Georgia Institute of Technology 

School of Industrial & Systeas 

Engineering 
Atlanta, GA 30332 

Ms. Rlltta Ruotsalalnen 
General Headquarters 
Training Section 
Military Psychology Office 
PL 919 

SF-00101 Helsinki 10, FINLAND 

Dr. Michael J. Saaet 
Perceptronlcs, Inc 
6271 Tar lei Avenue 
Woodland Hills, CA 91364 

Dr. Robert Sasaor 
Aray Research Institute 
5001 Elsenhower Avenue 
Aley-ndrla, TA 22333 

Dr. Roger Schank 

Yale University 

Coaputer Science Departaent 

P.O. Box 2158 

New Haven, CT 06520 



Dr. Janet Schofleld 
Learning R&D Center 
University of Pittsburgh 
Pittsburgh, PA 15260 

Dr. Marc Sebrechts 
Departaent of Psychology 
Wesleyan University 
Hlddletown, CT 06475 

Dr. JudlU) Segal 
Rooa 819F 
NIE 

1200 19th Street N.V. 
Washington, DC 20208 

Dr. Robert J. Seldel 
US Aray Research Institute 
5001 Elsenhower Ave. 
Alexandria, ?A 22333 

Dr. Raasay W. Selden 
NIB 

Mall Stop 1241 
1200 19th St. , NH 
Mishlngton, DC 20208 

Dr. Sylvia A. S. Shafto 
National Institute of Education 
1200 19th Street 
Mall Stop 1806 
Ntohlngton, DC 20208 

Dr. Lee Shulaan 
Stanford University 
1040 Cathcart Way 
Stanford, CA 94305 

Dr. Zlta M Slautls 
Instructional Technology 
Systeas Area 

ARI 

5001 Elsenhower Avenue 
Alexandria, VA 22333 

Drc H. Wallace Slnalko 
Manpower Research 

and Advisory Services 
Salthsonlan Institution 
801 North Pitt Street 
Alexandria, VA 22314 



61 



Caniegie-Mcllon University/Reder & Charney 

Dr. Derek Sleeian 

Stanford Ihilverslty 
School of Education 
Stanford, CA 94305 

Dr. Edward E. Salth 
Bolt Beranek & Newman, Tnc. 
50 Moulton Street 
Cairt>rldge, MA 02138 

Dr. Elliot Soloway 

Yale University 

Computer Science Department 

P.O. BoK 2158 

New Haven, CT 06520 

Dr. Richard Sorensen 
Navy Personnel R&D Center 
San Diego, CA 92152 

Dr. Kathryn T. Spoehr 
Brown University 
Department of Psychology 
Providence, RI 02912 

Dr. Robert Sternberg 
Department of Psychology 
Yale University 
BoK 11A, Yale Station 
New Haven, CT 06520 

Dr. Albert Stevens 
Bolt Beranek & Newman, Inc. 
10 Houlton St. 
Cambridge, MA 02238 

Dr. Paul J. Stlcha 
Seni jr Staff Scientist 
Training Research Division 
HuaRRO 

1100 ^. Mtshlngton 
kltXK. .. la, TA 22314 

Dr. Thomas Stlcht 

Navy Personnel R&D Center 

San Diego, CA 92152 

Dr. Martin N. Taylor 

DCIEM 

BoK 2000 

Oownsvlew, Ontario 
CANADA 



1985/08/28 

Dr. David Thlssen 
Department of Psychology 
University of Kansas 
Lawrence, KS 66044 

Dr. Douglas Towne 
Behavioral Technology Labs 
1845 S. Elena Ave. 
Redondo Beach, CA 90277 

Dr. Paul Twohlg 
Army Research Institute 
5001 Elsenhower Avenue 
Alexandria, VA 22333 

Headquarters, U. S. Marine Corps 
Code MPI-20 
N^lngton, X 20380 

Dr. Beth Uu*rcn 
Bolt Berandc & Newman, Inc. 
50 Moulton Street 
Cambridge, MA 02138 

Dr. Barbara Vhlte 
Bolt Berandc & Newman, Inc. 
10 Moulton Street 
Cambridge, MA 02238 

Dr. Robert A. Vlsher 

U.S. Army L^stltute for the 

Behavioral and Social Sciences 
5001 Elsenhower Avenue 
Alexandria, VA 22333 

Dr. Martin F. VlSkoff 
Navy Personnel R&D Center 
San Diego, CA 92152 

Mr. John H. Volfe 

Navy Personnel R&D Center 

San Diego, CA 92152 

Dr. Millace Vulfeck, III 
Navy Personnel R&D Center 
San Diego, CA 92152 

Df*. Joe Tasatuke 
AFHRL/LRT 

Lowry AFB, CO 80230 



ERiC 



62 



Carnegie-Mellon University/Reder & Charney 1985/08/28 

Dr. Joseph L« Toung 
Meaory & Cognitive 

Proceeses 
National Science Foundation 
Washington, DC 20550 



63 



